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Abstract 

It is well known that many local graph problems, like Vertex Cover and Dominating Set, 
can be solved in 2°( tw ' lU^ 1 * 1 time for graphs G = (V, E) with a given tree decomposition of 
width tw. However, for nonlocal problems, like the fundamental class of connectivity prob- 
lems, for a long time we did not know how to do this faster than tw°( tw ) lUI^ 1 - 1 . Recently, 
Cygan et al. (FOCS 2011) presented Monte Carlo algorithms for a wide range of connectiv- 
ity problems running in time c tw |V| c ' ( ' 1 ) for a small constant c, e.g., for Hamiltonian Cycle 
and Steiner tree. Naturally, this raises the question whether randomization is necessary to 
achieve this runtime; furthermore, it is desirable to also solve counting and weighted versions 
(the latter without incurring a pseudo-polynomial cost in terms of the weights). 

We present two new approaches rooted in linear algebra, based on matrix rank and de- 
terminants, which provide deterministic c 1:w |l^| c>< - 1 ^ time algorithms, also for weighted and 
counting versions. For example, in this time we can solve Traveling Salesman or count 
the number of Hamiltonian cycles. The rank-based ideas provide a rather general approach 
for speeding up even straightforward dynamic programming formulations by identifying 
"small" sets of representative partial solutions; we focus on the case of expressing connec- 
tivity via sets of partitions, but the essential ideas should have further applications. The 
determinant-based approach uses the matrix tree theorem for deriving closed formulas for 
counting versions of connectivity problems; we show how to evaluate those formulas via 
dynamic programming. 



1 Introduction 

The notion of treewidth proved to be an excellent tool for dealing with many NP-hard problems 
on graphs. In the 1970s and 1980s, several groups of researchers discovered the concept indepen- 
dently. In their fundamental work on graph minors, Robertson and Seymour [13] introduced the 

*Part of the work was done at Utrecht University supported by the Nederlandse Organisatie voor Weten- 
schappelijk Onderzoek (NWO), project: 'KERNELS'. 

^Supported by the Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO), project: 'Space and 
Time Efficient Structural Improvements of Dynamic Programming Algorithms'. 
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notions treewidth and tree decomposition, and these became the dominant terminology. The no- 
tion has been extensively studied and used in various areas of (theoretical and applied) computer 
science (see for example [7] for a survey). Informally, the notion measures how well a graph can 
be decomposed in a tree-like manner, resulting in a so-called tree decomposition. This is useful 
since many efficient algorithms solving NP-hard problems on trees generalize to efficient algo- 
rithms for graphs with good tree decompositions. Almost without exception these algorithms 
crucially rely on the dynamic programming paradigm, so studying the complexity of problems 
on graphs of small treewidth amounts to studying the dynamic programming paradigm. 

Two influential results are Bodlaender's [8] and Courcelle's theorems [16], showing that if 
we assume that input graphs have bounded treewidth, then there are linear time algorithms 
to find an optimal tree decomposition and for each property that can be expressed in monadic 
second order logic, given such a tree decomposition, to decide if the property holds for the input 
graph. Algorithmic engineering evaluations of Bodlaender's and Courcelle's algorithms are not 
encouraging however, due to the large constant factors in the running times, even for small 
values of the treewidth, e.g., the running time of Bodlaender's algorithm is 0(tw°( tw ^n). 

Hence a natural question is how much we can optimize the dependence on the treewidth, 
that is, we aim for a running time of the type /(tw)n c on graphs with n vertices and a tree 
decomposition of width tw of where we first aim at obtaining a small growing (but, since we 
assume V ^ NV, exponential) function /(tw) and second a small exponent c. For problems 
with locally checkable certificates, that is, certificates assigning a constant number of bits per 
node that can be checked by a cardinality check and iteratively looking at all neighborhoods of 
the input graph0, it quickly became clear that /(tw) only needs to be single-exponential. See 
\i'6\ 142] for sample applications to the Independent Set /Vertex Cover problems. From the work 
of |31j and known Karp-reductions between problems it follows that this dependence cannot be 
improved to subexponential algorithms unless the Exponential Time Hypothesis (ETH) fails, 
i.e., unless CNF-SAT has a subexponential algorithm. In [37] it was shown that under a stronger 
assumption (the so-called Strong Exponential Time Hypothesis, SETH), the current algorithms 
are optimal even with respect to polynomial jumps, that is, problems with current best running 
time /(tw)?! ^ 1 ) cannot be solved in /(pw) 1- ^^ 1 ) for positive e where /(pw) is 2 pw , 3 pw for 
respectively Independent Set and Dominating Set. While there is no consensus opinion on 
whether ETH and SETH are true, improving beyond lower bounds proven under either of them 
is at least as hard as improving the state of the art of CNF-SAT in the respective way. 

A natural class of problems that does not have locally checkable certificates are connectivity 
problems such as Hamiltonian cycle and Steiner Tree (see for example Section 5]), begging 
the question whether these can be solved within single-exponential dependence on tw as well. 
Early work shows that if we assume, in addition to small treewidth, that the input graph is 
planar, or, more general, avoids a minor, then many connectivity problems have algorithms with 
single-exponential dependence of tw, exploiting Catalan structures [20J. A positive answer to the 
question, using a randomized approach was found by Cygan et al. [18] using an approach termed 
"Cut & Count": It provided a transformation of the natural certificates to "cut-certificates" 
transforming the connectivity requirement into a locally checkable requirement. The transfor- 
mation is only valid modulo 2, but by a standard technique [JT] introducing randomization, the 
decision variant can be reduced to the counting modulo 2 variant. This result was considered 
surprising since in the folklore 2 c '( twlo s tw )n c '( 1 ) dynamic programming routines for connectivity 
problems all information stored seemed needed: Given two partial solutions inducing different 
connectivity properties, one may very well be extendable to a solution while the other one is 

For example, for the odd cycle transversal problem that asks to make the input graph by removing at most 
k vertices, a locally checkable certificate would be a solution set combined with a proper two-coloring of the 
remaining bipartite graph. 
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not (this resembles the notion of Myhill-Nerode equivalence classes [29J ) . 

The Cut & Count approach is one of the algorithms from the family of dynamic program- 
ming based algorithms using a modulo 2 based transformation [U EJ ESI ESI ESI US]- These 
algorithms give the smallest running times currently known, but have several disadvantages 
compared to traditional dynamic programming algorithms: (a) They are probabilistic, (b) The 
dependence on the inputs weights in weighted extensions is pseudo-polynomial, (c) They do 
not extend to counting the number of witnesses, (d) They do not give intuition for the optimal 
substructure / equivalence classes. An additional disadvantage of the Cut & Count approach 
of [18], compared to traditional dynamic programming algorithms on tree decompositions, is 
that their dependence in terms of the input graph is superlinear. Our work shows that each of 
these disadvantages can be overcome, with two different approaches, both giving deterministic 
algorithms for connectivity problems that are singly-exponential in the treewidth. 

1.1 Our contribution 

Our contribution consists of two new approaches that resolve the aforementioned issues of 
the Cut & Count approach, the "Rank based" and "Squared determinant" approaches. They 
can be used to quickly and deterministically solve respectively weighted and counting versions 
of problems solved by the Cut & Count approach. Additional advantages of the rank based 
approach are that it gives a more intuitive insight in the optimal substructure / equivalence 
classes of a problem and that is has only a linear dependence on the input graph in the running 
time. The only disadvantage of both approaches when compared to the Cut & Count approach 
is that the dependence on the treewidth or pathwidth in the running time is slightly worse. 
However, although we did not manage to overcome it, this disadvantage might not be inherently 
due to the new methods. Due to the generality of our key ideas, we feel our methods may inspire 
future work not involving tree decompositions as well. 

Although both approaches apply to all problems studied in [18]. We only study (variants 
of) Steiner Tree, Hamiltonian Cycle and Feedback Vertex Set in this work in order 
to prevent losing focus. Our results on these problems are described in Table [TJ 





Problem 


Pathwidth 


Treewidth 


1 


Weighted Steiner Tree 


n(l + 2 w )P w pw a W 


n(l + 2 w + 1 ) tw tw a W 


2 


Traveling Salesman 


n ( 2 + 2 aV2)pw pw O(l) 


n(5 + 2 (^+ 2 )/ 2 ) t »tw°( 1 ) 


3 


fc-Path 


n ( 2 + 2 c/2)p W ( fc + pw )0(l) 


n (5 + 2( u + 2 )/ 2 )*»(A; + tw) ( 1 ) 


4 


Feedback Vertex Set 


n(l + 2 aJ )P w pw c '( 1 ) 


n(l + 2 w+1 ) tw tu W 


5 


# Hamiltonian Cycle 


0(6P w pw°«n 2 ) 


0(15 tw tw°( 1 )n 2 ) 


6 


# Steiner Tree 


0(5P"pw°( 1 )n 3 ) 


O(10 tw tw°( 1 )n 3 ) 


7 


Feedback Vertex Set 


0(5P"pw°( 1 )n 3 ) 


©(lO^tw^Wn 3 ) 



Table 1: Table with our results. Rows 1 — 4 are discussed in Section [3] while rows 5 — 7 are 
discussed in Section HJ Line 7 is the result of applying the determinant approach to Feedback 
Vertex Set (note that we do not solve the counting variant). The symbol oj denotes the 
matrix multiplication exponent (currently it is known that lo < 2.3727 due to [47]). 



Since one of the main strengths of the treewidth concept seems to be its ubiquity, it is perhaps 
not surprising that our results improve, simplify, generalize or unify a number of seemingly 
unrelated results. In all cases, problem instances can be reduced to instances with small tree- 
or pathwidth using standard techniques. This is further discussed in Subsection 11.21 

We would like to mention that very recently, a subset of the current authors found an 
efficient rank bound of a partial solution versus partial solution matrix for the Hamiltonian 
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cycle problem. We will use this in the current to get a low running time for the Traveling 
Salesman problem. 

1.1.1 Rank based approach 

Our first tool is the rank based method (presented in Section [3]). This is based on a very generic 
idea to improve a dynamic programming algorithm, that we will now outline. 

Recall that a dynamic programming algorithm fixes a way to decompose certificates into 
'partial certificates', and builds partial certificates in a bottom- up manner while storing only 
their essential information. Given some language L C {0, 1}*, this is typically implemented by 
a defining an equivalence ~ on partial certificates x, y G {0, l} k such that x ~ y if xz G L o 
yz G L, for every extension z G {0, 1}'. For connectivity problems on treewidth, the number of 
non-equivalent certificates can be seen to be larger than our running times. For example [H] 
for a lower bound in communication complexity. 

We will use however, that sometimes we can represent the joint essential information for 
sets of partial certificates more efficiently than naively representing essential information for 
every partial certificate separately. The rank based approach achieves this as follows: Given a 
dynamic programming algorithm, consider the matrix A whose rows and columns are indexed 
by partial certificates, with A[x, y] = 1 if and only if xy G L. Then observe that if a set of rows 
X C {0, l} n is linearly dependent (modulo 2), any partial certificate x G X is redundant in the 
sense that if xz G L there will be y G X with yz G L. Hence, the essential information can be 
reduced to rk(A) partial certificates. 

For getting this approach to work we require an upper bound on the rank of the matrix M 
defined as follows: Fix a ground set U and let p and q be partitions of U (p and q represent 
connectivity induced by partial solutions), define M\p, q] to be 1 if and only if the meet of p and q 
is the trivial partition, that is, if the union of the partial solutions induce a connected solution. 
Although this matrix has dimensions of order 2"d c/ l tel^D, we given a simple factorization in 
GF(2) of matrices with inner dimension 2' 17 ' using an idea of [18]. Interestingly, our factorization 
follows from more generic results in communication complexity |391 I40j . Furthermore, our 
factorization (Lemma l3.13p can be derived from the much more general setting of communication 
complexity [39\ I40j (or more specifically, Lemma 5.7 from |39|). 

1.1.2 Squared determinant approach 

Our second tool is the squared determinant approach (presented in Section 0]). This gives a 
generic transformation of counting connected objects to a more local transformation. In [T5] the 
existence of such a transformation in GF(2) was already given. For extending this to counting 
problems, we will need three key insights. The first insight is that (a variant of) Kirchhoff's 
matrix tree theorem gives a reduction from counting connected objects to computing a sum 
of determinants. However, we cannot fully control the contribution of a connected object (it 
will appear to be either 1 or -1). To overcome this we ensure that every connected object 
contributed exactly once, we compute a sum of squares of determinants. The last obstacle is 
that the computation of a determinant is not entirely local (in the sense that we can verify a 
contribution by iteratively considering its intersection with all bags) since we have to account for 
the number of inversions of a permutation in every summand of the determinant. To overcome 
this, we use that this in fact becomes a local computation once we have fixed the order of the 
vertices in a clever way. 
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1.2 Relations to previous work 

As mentioned before, our results improve, simplify, generalize or unify a number of seemingly 
unrelated results. We will support this claim in this subsection. 

1.2.1 Algorithms for problems with small solutions. 

Although we do not improve the running time of known algorithms, a significant advantage of 
our approach is that it unifies several known non-trivial algorithms. We proceed by giving three 
important examples: 

Finding long paths In [2], the authors gave a deterministic 2 ( ~'^ > \E\ lg \V\ time algorithm 
that finds a simple path on k vertices in a graph G = (V,E), resolving the open question 
whether simple paths of length logn can be found in polynomial time from [43| . In a follow-up 
work, p3] this was improved to a 4 fc+C) ( log fc )|T^||.E| time algorithm. All these algorithms use the 
(arguably) involved construction of perfect hash families, and no 2 c '( fc )|V r | c, ( 1 ) time deterministic 
algorithm avoiding the use of such families was previously known. 

As a corollary of our technique we can obtain a simple O^^^fc ^! V"| + |.E|) time algorithm, 
or an 0(4.28 k k°^\V\ + \E\) with a standard technique from [23] (see also [10]) as follows. 
Create a depth first search tree of the input graph; if the height of the tree is more than k, 
the longest path from a leaf to the root gives a fc-path and we are done. Otherwise, there is a 
path decomposition of width at most k, with for every leaf-root path a bag with the vertices on 
this path. Since this can be performed in linear time (see [10] for details) we can respectively 
apply a simple variant of the algorithm from Section 13.41 or the algorithm from Theorem 13.201 
to obtain the algorithms. 

Finding feedback vertex sets Many papers (see [18} [13] and the references therein) have 
been devoted to the Feedback Vertex Set problem: Given an input graph G = (V, E) and 
a (small) parameter k, can we remove at most k vertices from G in order to obtain a forest? 
It should be noted that if this is indeed the case, then a tree decomposition of width k + 1 of 
G is easily obtained from a solution X by adding X to all bags of a tree decomposition of the 
forest V\X. Based on this simple observation, deterministic 2°^kP^\V\ + \ E\ algorithms are 
easily obtained by using a constant-factor approximation or the method of iterative compres- 
sion. We would like to mention that this is very different from previously known deterministic 
2 0(fc)fc0(i)|yp(i) a ig or ithms that all rely on a measure-based branching strategy. 

H- minor free graphs In [19] . it was shown that any H- minor-free graph either has treewidth 
bounded by 0(Vk), or a 2\fk x 2Vk grid as a minor. Many problems can easily be solved once 
we know that the input graph has such a grid (for instance a 2\fk x 2\fk grid as a minor 
guarantees that the graph does not have a vertex cover smaller than k or does have a 4/c-path). 

Thus, we are left with solving the problem with the assumption of bounded treewidth. 
In the case of problems with a local verification algorithm such as vertex cover, a standard 
dynamic programming algorithm then gives us a 2°^^^rP^ algorithm to check whether a 
graph has a vertex cover no larger than k. In the case of /c-path, however, the standard dynamic 
programming routine givesa2°(^ lo s fc )n°( 1 ) complexity. Motivated by this a number of papers 
showed that the fact that G is iif-minor free can be exploited to give 2 ^ t ^n ^ time algorithms 
(see |20] and the references therein). In [18] this result was extended to general graphs at the 
cost of randomization and a pseudo-polynomial dependence on the input weights, if present. In 
the current work we resolve the latter issues thereby fully unifying these previous results. 
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1.2.2 Graph classes with small treewidth 

Sometimes the input is restricted to a graph class that is guaranteed to have small treewidth 
by known results. We survey here some connections of our work to previous results that are 
more tailor made for such a graph class. 

Bounded degree A number of problems has been studied in the setting were the input 
graph has bounded degree. For example, the Traveling Salesman has received considerable 
attention [51 [22] [261 E2] ■ Our contribution is a derandomization at the cost of a slightly larger 
base of the exponential dependence. 

Throughout the following, we let n denote the number of vertices of the given graph. Then 
the following theorem by Fomin et al. reduces the bounded degree setting to small treewidth: 

Theorem 1.1 ([23]). For any e > there exists an integer n e such that for any graph G with 
n > n e vertices, 

/ , 1 1 13 
pw(G) < -n 3 + -n 4 + — n 5 + n> 6 + en, 
b d 60 

where Hi is the number of vertices of degree i in G for any i G {3, . . . , 5} and n>$ is the number 
of vertices of degree at least 6. 

This theorem is constructive, and the corresponding path decomposition (and, consequently, 
tree decomposition) can be found in polynomial time. Using this result one can get fast de- 
terminstic algorithms for all the connectivity problems listed in Subsection 1.3.3 in [18] , In 
this paper we restrict ourselves to the most studied setting, Traveling Salesman problem 
for cubic graphs. In [18J a l^Ol™??.^ 1 ) Monte-Carlo algorithm was obtained for Hamiltonian 
cycle; Very recently in [T7j, this is improved to a 1.1583 n n c '( 1 ) time Monte-Carlo algorithm 
for Hamiltonian cycle. By combining the ideas of this paper with a result from |17j . we ob- 
tain a l^lSG™!!^ 1 ) time deterministic algorithm for the Traveling Salesman problem in 
Corollary I3T91 

Planar graphs Recall from the previous subsection that n denotes the number of vertices of 
the given graph. Here we begin with a consequence of [25]: 

Proposition 1.2 For any planar graph G, tw(G) + 1 < |\/4.5n < 3.183-^/n. Moreover 

a tree decomposition of such width can be found in polynomial time. 

Using this we immediately obtain the following result for Traveling Salesman on planar 
graphs. 

Corollary 1.3. There exists an algorithm that solves Traveling Salesman on planar graphs 
in 4.28 3 - 183 v / ™ n C(i) = 26-677^0(1) Ume 

The best known algorithm so far was the 0(2 6 ' 9O3 ^™)-time algorithm of Bodlaender et al. 
|21j . A 4 3 - 183 \/" n c '( 1 ) randomized algorithm for Hamiltonian cycle was given in |18j . 

Similarly, we obtain an 0(2 6 677v/ ™)-time deterministic algorithm for fc-cycle on planar graphs 
(compare to the 0(2 7 223 v / ") time of [21J), and well-behaved c^-time algorithms for the other 
connectivity problems studied in [15] . 
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2 Preliminaries 



We use standard graph theory notation. Additionally for a subset of edges X C E of an 
undirected graph G = (V, E) by G[X] we denote the subgraph induced by edges and endpoints 
of X, i.e. G[X] = (V(X),X). For X,Y C V we let E(X,Y) be the set of all edges with one 
endpoint in X and one in Y. For a vertex i> and X C 1/ we denote degj^(f) for the number of 
neighbors of t> contained in X. 

Partitions and the partition lattice. Given a base set U, we use n([7) for the set of 

all partitions of U. It is known that, together with the coarsening relation C, n(C7) gives a 
lattice, with the minimum element being {U} and the maximum element being the partition 
into singletons. We denote n for the meet operation and U for the join operation in this lattice; 
these operators are associative and commutative. We use U2(U) C n(C/) to denote the set of all 
partitions of U in blocks of size 2, or equivalently, the set of perfect matchings over U. Given 
p £ n([7) we let #blocks(p) denote the number of blocks of p. If X C U we let p±x £ n(X) 
be the partition obtained by removing all elements not in X from it, and analogously we let for 
U C X denote p+x £ H(X) for the partition obtained by adding singletons for every element in 
X \ U to p. Also, for X C U, we let U[X] be the partition of U where one block is {X} and all 
other blocks are singletons. If o, b G U we shorthand U[ab] = U[{a,b}]. The empty set, vector 
and partition are all denoted by 0. 

Tree decompositions and treewidth. A tree decomposition [25] of a graph G is a tree T in 
which each node x has an assigned set of vertices B x C V (called a bag) such that UxeT B x = V 
with the following properties: 

• for any uv £ E, there exists an x £ T such that u, v G B x . 

• if v € and v £ B y , then v £ B z for all z on the (unique) path from x to y in T. 

The treewidth tw(T) of a tree decomposition T is the size of the largest bag of T minus one, 
and the treewidth of a graph G is the minimum treewidth over all possible tree decompositions 
of G (thus the graphs of treewidth one are exactly the forests and trees and that are not also 
independent sets). Finding a tree decomposition of minimum treewidth is AA'P-hard |3j, but for 
each fixed integer k there is a linear time algorithm for finding a tree decomposition of width 
at most k (if it exists) |8j. In this paper, we will always assume that tree decompositions of the 
appropriate width are given. 

Dynamic programming algorithms on tree decompositions are often presented on nice tree 
decompositions, introduced by Kloks [M]; see also [28] regarding treewidth and dynamic 
programming. We present a slightly augmented variant that specifies bags/nodes for introducing 
edges; this was already used by Cygan et al. [18 1. 

Definition 2.1 (Nice Tree Decomposition). A nice tree decomposition is a tree decomposition 
with one special bag z called the root and in which each bag is one of the following types: 

• Leaf bag: a leaf x of T with B x = 0. 

• Introduce vertex bag: an internal vertex x of T with one child vertex y for which 
B x = B y L) {v} for some v ^ B y . This bag is said to introduce v. 

• Introduce edge bag: an internal vertex x of T labeled with an edge uv £ E with one 
child bag y for which u,v £ B x = B y . This bag is said to introduce uv. 
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• Forget bag: an internal vertex x of T with one child bag y for which B x = B y \ {v} for 
some v £ By. This bag is said to forget v. 

• Join bag: an internal vertex x with two child vertices I and r with B x = B r = B\. 
We additionally require that every edge in E is introduced exactly once. 

Proposition 2.2. Given a tree decomposition of some graph G = (V,E), a nice tree decompo- 
sition rooted at an empty bag, an introduce edge bag for any choice of {u, v} G E or an forget 
vertex bag can be computed in ntw^ 1 ) time. 

By fixing the root of T, we associate with each bag x in a tree decomposition T a vertex set 
V x Q V where a vertex v belongs to V x if and only if there is a bag y which is a descendant of 
x in T with v £ B y (recall that x is its own descendant). We also associate with each bag x of 
T a subgraph of G as follows: 



Path decompositions and pathwidth. A path decomposition is a tree decomposition where 
the tree of nodes is restricted to be a path. The pathwidth of a graph is the minimum width of 
all path decompositions. Path decompositions can, similarly as above, be transformed into nice 
path decompositions, these obviously contain no join bags. 

Further notation. Given a graph G = (V, E) and a For two integers a, b we use a = b to 
indicate that a is even if and only if b is even. We use N to denote the set of all non-negative 
integers. We use Iverson's bracket notation: if p is a predicate we let \p] be 1 if p if true and 
otherwise. If u : U — > {1, ... , N}, we shorthand ui(S) = J2eeS u ( e ) f° r S Q U. For a function 
s by s[v — > a] we denote the function s \ {(v, s(v))} U {(v, a)}. Note that this definition works 
regardless of whether s(v) is already defined or not. We use either s\x or S|x to denote the 
vector obtained by restricting the domain to X. 

3 The rank based approach 

This section is devoted to a complete presentation of our rank based approach for connectivity 
problems parameterized by treewidth. At the heart of the approach is a technique for reducing 
large sets of partial solutions, expressed as weighted partitions (to be defined later), down to 
smaller sets that maintain the same optimal solution value along with at least one optimal solu- 
tion (though we point out that this reduction by design cannot maintain all optimal solutions). 
The main result behind the approach is presented in Section 13. 2\ it ensures that we can always 
find a small set of representative partial solutions. To avoid creating a series of ad hoc results for 
single problems, we introduce a collection of operations on families of weighted partitions, such 
that our results apply to any dynamic programming (DP) formulation that can be expressed 
using these operators only (see Section [3~T]) . 

In Sections 13.31 13.41 and 13.51 we give DP formulations using our operators for Steiner 
Tree, Traveling Salesman, and Feedback Vertex Set respectively. Except for Feed- 
back Vertex Set, where this turns out to be more involved, the programs are close to naive 
formulations that give runtimes 2^( tw ' logtw ) (note that our operators and language of weighted 
partitions are nonstandard). At the first read of this section, it is perhaps useful to read only 
one of the DP formulations, but the different problems solved by them should indicate the 
versatility of our operators. 



G 




V X ,E X = {e\e is introduced in a descendant of x } 
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Section 13.61 presents the proofs for the main building blocks of the approach (those given in 
Section f3.2p . Finally, Section T3.7I discusses limitations and possible improvements to the results 
presented in this section. 



3.1 Operators on sets of weighted partitions 

We will now introduce formally what we mean by sets of weighted partitions and followed by a 
definition of the mentioned collection of operations on such partition sets. 

Definition 3.1 (set of weighted partitions). Recall that n([7) denotes the set of all partitions 
of some set U. A set of weighted partitions is a set A C TL(U) x N, i.e., a family of pairs, each 
consisting of a partition of U and a non-negative integer weight. We say that A is unweighted 
if (p, w) € A implies that w = 0. 

The operators naturally apply to connectivity problems by allowing, e.g., gluing of connected 
components (i.e., different sets in a partition), or joining of two partial solutions by taking the 
meet operation n on the respective partitions. We will later see that if the recurrence only uses 
these operators, then the naive algorithm evaluating the recurrence can be improved beyond 
the typical 2 n ( tw ' lo s tw ) that comes from the high number of different possible partial solutions. 

For notational ease, we let rmc (A) denote the set obtained by removing non-minimal weight 
copies, i.e., 

zmc(A) = { (p, w) £ A\$(p,w') £ AAw' < w} . 

Definition 3.2 (operators on weighted partitions). Let U be a set and A C Tl(U) x N. 

Union. For B C H(U) xN, define A^B = rmc(.AUi3). Combine two sets of weighted 
partitions and discard dominated partitions. 

Insert. For X D U = 0, define in.s(X,A) = {(p^uux, w) I (p,w) £ A}. Insert addi- 
tional elements into U and add them as singletons in each partition. 

Shift. For w' £ N define shft(w',A) = {(p,w + w')\(p,w) GA}. Increase the 
weight of each partition by w' . 

Glue. For u, v, let U = U U {u, v} and define glu.e(uv, A) C T1(U) x N as 
glne(uv,A) = rmc(|(?7['Ut;] n p^jj,w) (p,w) £ A^). 

Also, if u) : U X U — >■ N, let glue aj («v, ^4) = shf t(w(u, v), glue(uv, A)). In each 
partition combine the sets containing u and v into one; add u and v to the base 
set if needed. 

Project. For X C U let X = U \ X, and define proj(X,.4) C n(X) x N as 

projpf,„4) = rmc(^(p iY ,w) (p, w) £ A A Me G X : 3e £ X : p C £/[ee'] j). 

Remove all elements of X from each partition, but discard partitions where this 
would reduce the number of blocks/sets. 

Join. For B C U(U') X N let U = U U U' and define join(^4, B) C 11(17) x N as 

join(^l,e) = rmc( j(p t £ n q^,Wi + 1^2) (p,wi) £ A A (q,w 2 ) £ b\). 

Extend all partitions to the same base set. For each pair of partitions return the 
outcome of the meet operation n , with weight equal to the sum of the weights. 
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Regarding the definition, note the role of U[ab]: Using p n U[ab] we obtain a partition that 
is the same as p except that the sets containing a and b are now merged into one (if they were 
one set already then nothing happens). When we use p C U[ab] then this is true if a and b are 
in the same set in the partition p (but the set can be larger than just {a, b}). 

Note also that ins(X,A) and shft(,a) re the only operators that do not require rmc() in its 
definition; all other operators may create weighted partitions that consist of the same partition 
but with different weights (we want to keep only the cheaper one). 

Straightforward implementation gives the following: 

Proposition 3.3. Each of the operations union, shift, insert, glue and project can be performed 
in S\U\°^ time where S is the size of the input of the operation. Given A, B, join(„4, B) can 
be computed in time \A\ ■ \B\ ■ li/p^ 1 ). 

3.2 Representing collections of weighted partitions 

The key idea for getting a faster dynamic programming algorithm is to follow the naive DP, 
but to consider only small representative sets of weighted partitions instead of all weighted 
partitions that would be considered by the naive DP. Intuitively, a representative (sub)set of 
partial solutions should allow us to always extend to an optimal solution provided that one of 
the complete set of partial solutions extends to it. Let us define this formally. 

Definition 3.4 (Representation). Given a set of weighted partitions A C IT(i7) x N and a 
partition q G n(C7), define 

opt(q, A) = min {w \ (p, w) £ A A p n q = {U}} . 

For another set of weighted partitions A' C TL(U) x N, we say that A' represents A if for all 
q £ U(U) it holds that opt(q,A') = opt(q,A). 

Note that the definition of representation is symmetric, i.e., if A' represents A then A also 
represents A' . However, we will only be interested in the special case where A' C A and where 
we have a size guarantee for finding a small such subset A' . 

Definition 3.5 (Preserving representation). A function / : 2 n ( l7 ) xN x2-> 2 n ( f/ ') xN is said to 
preserve representation if for every A, A' C H(U) x N and z E Z it holds that if A' represents 
A then f(A', z) represents f(A, z). (Note that Z stands for any combination of further inputs.) 

Completing the required tools, the following lemma and theorem establish that the opera- 
tions needed for the DP preserve representation, and that we can always find a reasonably small 
representative set of weighted partitions. The proofs are deferred to Section 13.61 

Lemma 3.6. The union, insert, shift, glue, project, and join operations from Definition \3.2\ 
preserve representation. 

Theorem 3.7 (reduce). There exists an algorithm reduce that given set of weighted partitions 
A C U(U) x N, outputs in lAft^W^U] ^ time a set of weighted partitions A' C A such 
that A' represents A and \ A'\ < 2^, where uj denotes the matrix multiplication exponent. 

It was recently shown that u < 2.3727 |47| . 
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3.3 Application to Steiner Tree. 

In this section we show how to solve the Steiner Tree problem via a dynamic programming 
formulation that requires only the operators introduced in Section 13.31 



Steiner Tree 

Input: A graph G = (V, E) weight function oj: E — >■ N\ {0}, a terminal set K C V and a 
nice tree decomposition T of G of width tw. 

Question: The minimum of oj{X) over all subsets X C E of G such that G[X] is connected 
and K C V{G[X\). 



Of course, since the weights are positive, in an optimal solution X indeed induces a tree 
as the problem name suggests. We will start by restating the recurrence used by the folklore 
algorithm for solving this problem using the introduced terminology on weighted partitions. 
Generally, we will denote the (to be computed) tables as A x (-) whereas £ x (-) stands for a set of 
partial solutions; in both cases x denotes the current bag. For a bag x, and s G {0, l} Bx define 

-l 



A x(s) = {{p, mm u(X) 
Xe£ x (p,s) 



S x (p, s) = |X C E x yv G B x : v G V(G[X]) V v G K ^ s{v) = 1 

A Vf i, V2 G s~ (1) : V1V2 are in same block in p o v\,V2 connected in G[X] 
A#blocks(p) = cc(G[X])}. 

Note that s : B x — > {0, 1} expresses which vertices we chose for the Steiner tree (namely those 
with s(v) = 1). Intuitively, £ x (p,s) is the set of partial solutions having (a subset of) s _1 (l) as 
incident vertices in B x and connecting the vertices of s _1 (l) according to p. Furthermore, the 
definition ensures that all connected components spanned by the edges of any partial solution 
contain at least one vertex of the current bag, and all terminals are contained in some connected 
component. Thus if we pick the tree decomposition T such that the root is the forget node, 
say x, for some terminal, say v, then we can check at the (single) child y of x the entry A y (s) 
where s(v) = 1 (there are no other vertices in this bag): This allows only the partition p = {{v}}, 
and by definition it must correspond to a minimum weight set of edges that spans a single 
connected component that contains all terminals. 

We proceed with the recurrence for A x (s) which is used by the folklore dynamic programming 
algorithm. In order to simplify the notation, let v denote the vertex introduced and contained 
in an introduce bag, and let y,z denote the left and right children of x in T, if present. We 
distinguish on the type of bag in T: 

Leaf bag x: 

A x {%) = {(0,0)} 

Indeed, £ x (p, s) only contains the empty set; it connects nothing and has weight 0. 

Introduce vertex v bag x with child y: 

' ins({v}, A y (s| B J), ifs(v) = l 
A x (s) = I Ay(s\ By ), ifs(v) = 0Av(£K 

Q, if s(v) = 0Av G K 

Using v for a Steiner tree corresponds to s(v) = 1, and we insert v as a singleton into 
each partition (as there are no edges incident with v yet). If v is a terminal, then not 
inserting v is not feasible. Else, if v ^ K, and we do not use v then we get the same 
partial solutions as the previous bag. 
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Forget vertex v bag x with child y: 



A x (s) = A y (s[v -> 0]) \bproj(v,A y (s[v -»■ 1])) 

We combine partial solutions that either include v or exclude v. If v is included, we ensure 
it was connected to other vertices by removing it with the project operation (if it was a 
singleton then the corresponding partition is effectively eliminated). 



Introduce edge e = uv bag x with child y: 

A x (s) ■- 



A y (s) if s(u) = V s(v) = 

A y (s) bb glue LJ (uv,A y (s)), otherwise. 



To be able to include the edge we need by the definition of £ x (p, s) that s(u) = s(v) = 1. 
If we include the edge, we account for the weight uj(u,v) and update the connectivity p 
by connecting u and v with the glue operation. 

Join bag x with children y and z: 

A x (s) = join(A y (s),A z (s)). 



We know that every partial solution represented in A x (s) can be obtained from partial 
solutions represented by A y (s) and A z (s). To combine two partial solutions from A y (s) 
and A z (s), we have to sum the weights of the used edges and join the connectivity, and 
this is exactly what the join operation does. 

Theorem 3.8. There exist algorithms that given a graph G solve Steiner Tree in time 
n(l + 2 w ) pw pw c '( 1 ) time if a path decomposition of width pw of G is given, and in time n(l + 
2^+i^tw tw o(i) fiuie if a tree decomposition of width tw of G is given. 

Proof. The algorithm is the following: use the above dynamic programming formulation as 
discussed to compute A r (where r is the child of the root, as discussed), but after evaluation 
of every entry A x , use Theorem 13.71 to obtain and store A x = reduce(A x ) rather than A x . 
Since A x = reduce(„4) represents A and the recurrence uses only the operators defined in 
Definition 13.21 which all preserve representation by Lemma 13.61 we have as invariant that for 
every x £ T the entry A' x stored for A x represents A x by Lemma 13.61 In particular, the 
stored value ^( s ) represents A r (s) and hence we can safely read off the answer to the problem 
from this stored value as done from A r (s) in the folklore dynamic programming algorithm. 
Let us focus on the time analysis: since for all operations from Definition 13.21 we can apply 
Proposition 13.31 and for obtaining the tree/path decomposition with the required properties we 
can use Proposition 12.21 the bottleneck clearly is the reduce algorithm. 

If we are given a path decomposition, it can easily be seen that the intermediate sets of 
weighted partitions are always of size at most 2' s and hence the time needed for com- 

puting reduce(A x .(s)) for any bag x can be upper bounded by Yli +ii=\B x \ ('^') l l °2 tJn pw C) ( 1 ) = 
(l + 2 w )P w pw°( 1 ). 

If we are given a tree decomposition, we need to consider the time required to compute 
A' x (s) were x is a join bag. Then the size of the intermediate sets of weighted partitions is easily 
upper bounded by 4} s W, and hence the time needed for computing reduce(A x (s)) can be 
upper bounded by £io+ii=|B»| (If^l^+^tw^ 1 ) = (1 + 2 w+1 ) tw tw°( 1 ). □ 
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3.4 Application to Traveling Salesman. 

In this section we give an algorithm for Traveling Salesman by expressing a corresponding 
dynamic programming using the operators from Section 13.11 



Traveling Salesman 

Input: A graph G = (V, E), weight function u: E — > N and tree decomposition T of G of 
width tw. 

Question: The minimum of oj(X) over all Hamiltonian cycles X C E. 



First, for technical convenience, we guess an edge v\v n G X that has to be included in the 
Hamiltonian cycle. Note that this can be done with only tw guesses since we can guess an edge 
adjacent to a vertex of minimum degree which is easily seen to be at most tw. Now, using 
Proposition 12.21 we turn the tree decomposition T into a nice tree decomposition that is rooted 
at the introduce edge bag for {vi,v n }; slightly abusing notation we refer to the latter as T. 
After accounting for the weight of {vi,v n }, this reduces the problem to tw instances of finding 
a minimum weight Hamiltonian path between two fixed vertices. 

For a bag x and s G {0, 1, 2} Bx define 



AJs) 



M, min u(X)) Af € n 2 (a -1 (l)) A^(Af,s) 

Xe£r(M,s) / J 



£ X (M, s) = {X C E x : v G B x -> deg x {v) = s(v) 
Av G V X \B X -> deg x (v) = 2 
A {u, v } G M — > u and v are connected in G^fX] 
A G^fX] contains no cycles}. 

In this case, s: B x — > {0,1,2} encodes the degree of vertices in B x in the corresponding 
partial solution (the degree bound and exclusion of cycles implies that these are collections 
of paths). Our partitions M G n2(s _1 (l)) store the pairing of degree-1 vertices induced by 
connecting paths. Again naively implemented this would give 

2 n(twio g tw) p artia i solutions, but 
our concept of representative sets gives the desired single-exponential runtime. 

Consider the table entry A z (s) where z is the root of T, s{v\) = s{v n ) = 1 and for v ^ vi,v n 
we have s(v) = 2. It is easy to see that this table entry is empty if there is no Hamiltonian 
path from v\ to v n and otherwise it is ({{vi,v n }},w) where w is the weight of the minimum 
Hamiltonian path. Hence, to solve the problem it suffices to compute A z (s). 

Leaf bag x: We have B x = 0. For ease of notation we permit a single table entry for the empty 
partition of B x into vertices labeled 0, 1, and 2: 

Introduce vertex v bag x with child y: We have B x = B y U {v}. For all s G {0, 1, 2} Bx we 
compute A x (s) as follows 

Ms) = !M*\b v ) Hs(v) = 0, 
I otherwise. 

Since v is just introduced it cannot have neighbors in V x and there is no change in con- 
nectivity. 

Forget vertex v bag x with child y: We have B y = B x U {v}. For all s G {0, l,2} Bx we 
compute A x (s) as follows 

A x (s) = A y (s[v -> 2]). 
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The vertex v cannot have neighbors outside V x so it must have its two neighbors in V x . 
Note that s[v -> 2] G {0, 1, 2} B y , with s(v) = 2. 

Introduce edge e = uv bag x with child y: We have B x = B y . For all s G {0, l,2} Ba; we 
compute At(s) as follows 

0, if s(«) = V s{v) = 0, 

glue u (t«;, J i4 1/ (s[«,i; -> 0])) if s(u) = s(v) = 1, 

proj({?;},glue tJ (TO,ylj / (s[u -> 0,« -> 1]))) if s(n) = 1 A s(v) =2, 

proj{{u},glue u (uv, A y (s[u -)• l,t> -> 0]))) if s(u) = 2 A s(t>) = 1, 

proj ({u, «}, glue aJ (tif , A y (s[u, v — > 1]))) otherwise. 



A x (s) = A y (s) tb < 



In all cases, an optimal solution may simply make no use of the edge e; hence we copy the 
set of matchings from the child accordingly (this gives the term A y (s)). If s(u) or s(v) is 
0, the edge cannot have been used. When considering partial solutions using e, we have 
to use the entry of A y where the degree of u and v is decreased by 1 to account for the 
edge. In the case that s(u) and s(v) are 1 we can simply add the edge to the matching. 
In the case that s(u) = 1 and s(v) = 2 (or the symmetric opposite), we have to glue e 
to M, meaning that in the new matching u is matched with the vertex, say w, that v 
was previously matched with; here glue first creates a set {u, v, w} and project shrinks it 
to {u, w} (since v now has degree two and its specific connectivity needs not be traced). 
In the case that s(u) and s(v) both are 2, including e in a matching M in A y (s) gives the 
matching M \ {au, bv} U {ab} for some a, b. We have to ensure that {a, b} ^ {u, v} which 
is done by projecting (if {a, 6} = {u,v} then projection eliminates the partition). 

Join bag x with children y and z: We have B x = B y = B z and compute A x (s) for all s G 
{0,1, 2} B * as follows 

A x (s)= y P roj( S - 1 (2)\(r 1 (2)Ur- 1 (2)),join(vl s/ (l),^(r))) 

l+r=s 

Note here that 1, r,s G {0, l,2} Bx hence the summation is vector summation. Since we 
combine two characteristics of partial solutions into a new one, the degrees of the left 
and right partial solution (1 and r) have to sum up to the degrees of the new one (s). 
Two characteristics (Mi,wi) G A y (l) and (M2,W2) G A z (r) combine to a characteristic 
of A x (s) if and only if Mi U M2 is acyclic which is equivalent to saying that all vertices 
in s _1 (2) are connected to vertices in s _1 (l) in the resulting partition Mi n M2, and the 
latter is ensured by the project operation. 

Using the tools from Subsection [321 we obtain the following result. However, it should be noted 
that we give an improvement of this in Subsection 13.61 this uses a non-trivial result from [17 1. 

Theorem 3.9. There exist algorithms that given a graph G solve Traveling Salesman in 
time n{2 + 2 w ) pw pw c '( 1 ) time if a path decomposition of width pw of G is given, and in time 
n(7 + 2 < - tJ+1 )) tw tw C) ( 1 ) time if a tree decomposition of width tw of G is given. 

Proof. The algorithm is the following: use the above dynamic programming formulation from 
Subsection 13.41 to compute A r , but after evaluation of every entry A x , use Theorem 13.71 to store 
A' x = reduce(Aj;) rather than A x . Since A' x = reduce(^l) represents A and the recurrence uses 
only the operators defined in Definition 13.21 which all preserve representation by Lemma I3.6( 
we have as invariant that for every x G T the entry A' x represents A x . In particular, the stored 
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value A' z (s) represents A z (s) where z is the root of T and hence we can safely read off the answer 
to the problem as done in the naive dynamic programming algorithm from A z (s)). 

Let us focus on the time analysis: since for all operations from Definition 13.21 we can apply 
Proposition 13.31 and for obtaining the tree/path decomposition with the required properties 
we can use Proposition 12.21 the bottleneck clearly is the reduce algorithm. Also, note that the 
guessing of the edge v\v n gives overhead of at most pw or tw so this will be subsumed by the 
last term of the claimed running time. 

In the first algorithm that is given a path decomposition, note we can assume x is either 
a leaf, introduce vertex, forget vertex or introduce edge bag. In this case the size of the 
intermediate sets of weighted partitions is by our invariant at most 2' s Wl Then the time 
needed to perform reduce (Aj(s)) is at most 2 W ' S Wlpw ^ 1 ) and the time to compute A x (s) for 
every {0, l,2} Bx is 



^ 2^~ 1 ( 1 V°( 1 ) < E (• ]l < °l*2 wil p W °W 



B x 



se{0,l,2} s ^ io+h+i2=\Bx\ 

= ( 2 + 2")l B *lp W °«, 

where the last equality is due to the multinomial theorem. Hence A' x can be computed for every 
x G T in the claimed time bound. 

For tree decompositions, note that if x is a join bag, and we denote A for the intermediate 
values in the computation of A'(x) then 

14,(8)1 < E 2' rl Wl2l r-1 WI = n 2[ J=1 W r = 1 ]=4l'" 1 Wl6l*" 1 ^l. 

l+r=s i=l l+r=Si 

where in the first equality we expand into independent products over all coordinates of the 
vectors and use the following simple observation in the second equality 



(1) 



Using this, it can also be seen that the reduce operation to obtain A' x (s) is performed in 
time bounded by 4l s ~ 1 ( 1 )l6l s ~ 1 ( 2 )l2( tJ - 1 )l s ~ 1 WI| J B :E | ( 1 ). Then the total time needed to evaluate 
A x (s) for every s G {0, 1, 2} Bx is bounded by 

( )P 2 (w+1)il 6* 2 =ra(7 + 2 ( ^ +1) ) |jBa:| , 

■ . • id i V0,il,*2/ 

lQ+ll+t2 = \B x \ 

by the multinomial theorem and the claim follows. □ 
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3.5 Application to Feedback Vertex Set. 

As a third application of the rank based approach we show how to formulate and solve Feed- 
back Vertex Set using a dynamic programming formulation based on the operators intro- 
duced in Section 1370 
Feedback Vertex Set 

Input: An undirected graph G = (V,E), an integer k and a nice tree decomposition T of 
G of width tw. 

Question: Find a set Y such that |V| < k and G[V \ Y] is a forest. 
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Using the operators for weighted partitions for solving Feedback Vertex Set requires a 
slight reformulation of the problem. The reason is that the operators are designed to maximize 
connectivity, whereas Feedback Vertex Set requires that we avoid creating cycles in intro- 
duce edge nodes of the tree decomposition. (It can be seen that certain more directly applicable 
operators do not preserve representation, e.g., selection of all partitions in which two vertices 
are connected, but we omit a detailed discussion at this point.) 

The idea for the reformulation is to seek an induced subgraph that is a tree on at least i = 
\V\ — k vertices; this is equivalent to requiring maximum connectivity using only i—1 edges. Of 
course, this requires that the connected components created by the deletion of a feedback vertex 
set can be connected into a single tree. To this end, we make the following changes: We modify 
G, by adding a special universal vertex vq to it, i.e., it is adjacent to all vertices of G. Denote 
Eq for the set of edges incident to vq. Then we ask for a pair (Y, Yq) such that Y C V \ {vq}, 
\Y\ < k, Yq is a subset of E , and the graph (V \ Y, E[V \Y]U Y ) is a tree. (By E[X\ we mean 
all edges in E with both endpoints in X.) This is clearly equivalent to the original problem 
statement since G[V\ (Y U {^o})] can be extended to a tree in this way if and only if it is a forest. 
We emphasize that the tree must contain all edges between all selected original vertices and 
may contain any edges incident on vo (this in particular affects the possibilities and introduce 
edge bags). Note also that we can modify the tree decomposition T accordingly by adding vo 
to all bags and making it nice again. 

For a bag x, integers i,j and s G {0, l} Bx define 

A x (s,i,j) = {(p,0)\p€ n^-^l)) AS x (p,B,i,j) + 0} 
S x (p,s,i,j) = {(X,X ) G 2 V * x 2*™* \\X\=iA \E X [X \ {v }} U X \ = j 
A x n B x = s _1 (l) Av eB x ^ s(v ) = 1 

AVue X\B x 3u e s _1 (l) : u, u connected in (X, E X [X \ {vo}] U Xq) 
A Vui, V2 € s~ 1 (l) : v\V2 are in same block in p ■<->■ v\ , V2 are connected 
in (X,E x [X\{v }]UX )}. 

In words, (p, 0) G A x (s,i,j) indicates that there exists a subset {vq} n V x C X C V x with 
Xr\B x = s _1 (l) and a subset Vo C E x C\Eq such that in the graph (V, E x [X\{vo}]L)Xq) we have 
i vertices, j edges, no connected component fully contained in V x \ B x , and that the elements 
of s~ 1 (l) are connected according to the partition p. It follows that the given instance of 
Feedback Vertex Set is a YES-instance if and only if for some i > \VL){v }\—k = \V\ — (k— 1) 
we have that A z (®, — is non-empty: For the forward direction, we can take a solution and 
extend it to a tree of the required type using the incident edges of vq. For the backward 
direction, we have that (V, E X [X \ {vq}] U Vo) contains i vertices and i — 1 edges and that it is 
connected; hence it is a tree and V \ X is a feedback vertex set. 

In order to simplify the notation, let v denote the vertex introduced and contained in an 
introduce bag, and let y, z denote the left and right children of x in T, if present. As usual, 
undefined table entries are assumed to be empty for notational convenience. We distinguish on 
the type of bag in T: 

Leaf bag x: 

4,(0,0,0) = {(0,o)} 

Clearly, if i = j = then £ x (0, i, j) = {(0, 0)} and it is empty otherwise. 
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Introduce vertex v bag x with child y: 



'0 if v = v A s(v) = 0, 

A x (s,i,j) = I ins({v},A y (s\ By ,i- l,j)), if s(v) = 1, 
Ay( s \B y ihj), otherwise. 

If v = vq we require s(v) = 1 by definition. Otherwise, if s(v) = 1, we account for its 
inclusion in X: We extend solutions where the number of vertices is z — 1 (effectively, this 
increases the number of vertices, as intended). 

Forget vertex v bag x with child y: 

A x (s,i,j) = A y (s[v -> 0],i,j) \hpToj(v,Ay(s[v -»• 



We combine solutions from the child bag where v can be included or excluded in the in- 
tended tree (since the current bag does not specify s(v)). For previous solutions with s(v) = 
1, we remove v from the partitions using the project operator; this eliminates partial so- 
lutions that have d as a singleton in the partition since that would create a separate 
component that can no longer be connected (deviating from building a single tree). 



Introduce edge e = uv bag x with child y 

A x {s,i,j) 



r A y (s,i,j) \h glue(v v,A y (s,i,j - 1)) if u = v A s(v) = 1, 
glue(uv, A y (s, i,j — 1)) if s(u) = 1 A s(v) = 1, 

A y (s,i,j) otherwise. 



If u = Vo (or, by symmetry, v = vq) we can choose to insert the edge vqv, and account for 
it by extending previous solutions with j — 1 edges. If s(u) = s(v) = 1 we have to include 
the edge uv in ^[X] and again build upon solutions with j — 1 edges. 

Join bag x with children y and z: 

A x (s,i,j)= join(A,(s,ii, j x ), A z (s,i 2 ,j 2 ))- 

«l+«2=i+s _1 (l) 
jl+j2=j 



We first compensate for vertices accounted for twice in the i counter since they were 
introduced in both subtrees of T by subtracting their number; these are exactly the 
vertices in s _1 (l) C B x (they are selected for the tree and by basic tree decomposition 
properties they must be contained in B x if they are in both subtrees). Then we simply 
add the number of edges of both subsolutions, and their connectivity is automatically 
joined by the join operator. 

We obtain the following theorem, whose proof is analogous to the proof of Theorem 13.81 and 
therefore omitted. However, let us explain why we can still obtain a time bound that is linear 
in n, despite the two additional table dimensions i and j of range 0(n). The trick here is to see 
that we do not need to fully evaluate the table, but that smaller ranges for i and j suffice. First, 
let us see that i G {j + 1, . . . , j + tw + 1}: If j > i then the partial solution must already contain 
a cycle (and every further added vertex needs at least one incident edge so we cannot reach i* 
vertices and i* — 1 edges). If i > j + tw + 1 then the table is empty, since matching partial 
solutions would have more than tw + 1 connected components, which violates the condition 



17 



that each component is connected to a vertex of the current bag. Second, to see that a small 
range of values for i suffices at each bag, consider the following: If we have a nonempty table 
entry A x (s,i,j), then any table entry A x (s',i',j') with i' < i — tw is suboptimal (and hence 
not required): We can always add B x \ {vo} to the implicit feedback vertex set of any solution 
in A x (s,i,j) to get a better solution than A x (s' , it is less constrained since its connected 

components contain only the mandatory vq from B x and it has at least i' vertices in connected 
components. 

Theorem 3.10. There exist algorithms that given a graph G solve Feedback Vertex Set 
in time n(l + 2 a; ) pw pw c '( 1 ) time if a path decomposition of width pw of G is given, and in time 
n(l + 2 w+1 ) tw tw c '( 1 ) time if a tree decomposition of width tw of G is given. 



3.6 Representing collections of weighted partitions based on rank 

Preserving representation. We first need to prove Lemma [3. 61 That is, that the operations 
union, insert, shift, glue, project, and join preserve representation. While this is an essential 
part of the rank based approach, the actual proofs are not particularly instructive to read and 
are postponed to Appendix IB. 31 



Finding small representative subsets. The remainder of this subsection is devoted to the 
proof of Theorem 13.71 The key idea is as follows: To find optimal partial solutions in a set A 
of weighted partitions, one checks for certain partitions q what is the minimum weight w such 
that A contains some pair (p, w) such that p n q gives the unit partition. For intuition let us 
ignore the weights for the moment and only look at the partitions in A. Very roughly we need 
to find a subset of those partitions that can complete any partition q to the unit partition {U}, 
assuming that some partition in A does that too (we only need to represent what A can do). 
It can be seen that any set cover of partitions p such that for any q at least one of them 
gives p V~\ q = {U} suffices. It turns out that taking a subset of partitions that form a basis in 
a certain matrix can play the same role, and is much easier to handle (both in proof and for 
finding it algorithmically) . Given that, it is not hard to get the additional property that the 
representative subset always matches the correct weight that the original set A would provide; 
this corresponds essentially to a basis of minimum weight. 

Our matrix simply states for all pairs p and q of partitions whether or not the meet operation 
applied to them gives the unit partition. The crucial part, of course, is to show that it has low 
rank, in order to guarantee a small basis. The matrix is formally defined as follows; for notational 
ease let us fix U = [t], and let us shorthand (Vi, Vj) for a partition {Vi, V2} G n({7). 



Definition 3.11. Define M G z^ {U)xTiiU) by 



M\p, q] 



1 pU q = {U}, 
else. 



The idea for getting a good rank bound for this matrix is to consider a simple class of 
partitions, namely cuts into only two sets (where the second set may in fact be empty). The 
subsequent lemma then shows that in arithmetic modulo two, the matrix Ai can be written as 
the product of two cutmatrices C, which are defined as follows. 

Definition 3.12. Define cuts(i) := {(Vi, V 2 ) | Vi U V 2 = U A 1 G V\}, where 1 stands for an 
arbitrary but fixed element of U. Define C G zJ (U)xcutB(t) by C[p, (Vi, V 2 )] = [(Vi, V 2 ) C p]. 
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Intuitively, the matrix C represents which pairs of partitions and cuts are consistent, i.e., 
the partition needs to be a refinement of the cut. It is crucial that one side of the cut is fixed 
to contain a particular vertex since that allows the following trick via counting modulo two: 
For each pair of partitions, the product CC T can be seen to count the number of partitions 
that are consistent with both p and q. If p n q = {U} then there is only one such partition. 
Otherwise, if p n q is a partition with at least two sets then there is an even number of cuts 
that are consistent (to see this, pair the cuts by including respectively excluding any set that 
does not include the special element 1 G V\). The formal proof is postponed to Appendix lB.il 

Lemma 3.13. It holds that M = CC T . 

From the factorization we pretty immediately get the following lemma that encapsulates the 
idea behind finding small representative subsets. It shows that linear dependence allows us to 
discard one of the corresponding partitions (e.g., the one of highest weight). 

Lemma 3.14. Let X C LT(C7) and q,r G II(J7) such that C[q, ■} = Y. p ex C iP> '] andr n q = {U}. 
Then, there exists p £ X such that r n p = {U}. 



Proof. We have that 



M[q, ■} = C[q, -}C T = C \P, -DC T = E M b> "J" 

pex pex 



Where the equivalences respectively follow by Lemma 13.131 assumption, and Lemma 13.131 
combined with linearity of matrix multiplication. In particular, M[q, r] = Ylp^x r]. Thus, 
if M [q, r] = 1 then M [p, r] = 1 for some p £ X and the lemma follows. □ 

At this point any naive algorithm for finding a lightest basis would suffice to complete our 
algorithm, e.g., this is straightforward via Gaussian elimination when the rows are ordered by 
weight. However, aiming for a faster algorithm, the following lemma finds the required basis 
faster via matrix multiplication; the proof is postponed to Appendix IB. 2[ 

Lemma 3.15. There is an algorithm that, given a n x m matrix with m < n and with entries 
from the field ¥2 and weights u : [n] — > N, finds a basis X C [n] of the row space minimizing 
u(X) in 0(nm u - 1 ). 

Now we can wrap up and prove Theorem 13.71 



Proof of Theorem \3. 7| The algorithm reduce is as follows: 



Algorithm reduce(^l) 
1: let A = {(pi,u>i), • • • , (pi,W£)} and A = {p 1} . . . ,pi}. 
if 1 < 2^1 then return A 

find a basis X C A of the row space of C[A, ■] minimizing Y1 P ex Wi us i n g Lemma 13.151 
return { (p, w) \ (p,w) £ A Ap £ X}. 



Clearly, A' = reduce(_4) C A. Since the number of columns of C equals 2^ _1 , X being a 
basis for the row space guarantees that \A'\ < The running time is clearly dominated by 
the call to the algorithm of Lemma 13 . 1 5 1 since any entry of C can be computed in IC/I^ 1 ) time. 
Then, since C[A, •] is a \A\ X 2 <_2 the claimed running time follows. 

It remains to argue that A' represents A. Suppose for a contradiction that this is not the 
case. Since A' C A we have for every q that opt(q,A) < opt(q,A'). Thus our assumption 
implies that opt(g, .A) < opt(q,A'), that is, for some q there is (p, w) £ A and q such that 



19 



P n q = {U} and w < opt(g , ,^l / ). Since X is a basis of the row space of C[A, ■] we know that 
the row C[p, •] is a linear combination of a set of rows from C[X, ■]. Let 7 Cite the set of 
indices of these rows. By Lemma [3.141 we know that there exists pi £ Y such that g n p,; = {U}; 
Hence, since w < opt(q,A'), it must be that Wi > w. But we have that (X \ {pi}) U {p} also 
is a basis of the row space of C[A, ■] since C[p$, •] is a linear combination of the rows indexed by 
(Y \ {pi}) U {p}. Since u>i > w, this contradicts that X minimizes Ylpi&x w i- ^ 

3.7 Improvements and limitations of the approach 

The main ingredient for the proof of Theorem 13.71 is Lemma 13.141 which in turn follows directly 
from the factorization Ai = CC T (Lemma I3.13p . Thus by establishing a better factorization, 
i.e., with smaller inner dimension, using matrices whose entries are computable in polynomial 
time, then we would immediately get improved algorithmic results. 

It can be seen that such an improvement is not possible: Assume that \U\ is odd and fix 
an element uq E U. The submatrix of Ai with rows and columns indexed by {£7[X] | Uq G 
X A |X| = (\U\ + l)/2} is easily seen to be an identity matrix, since the meet of two of such 
partitions gives the unit partition if and only if they are constructed from X\ and X<i with 
X\ = U \ X2 U {no}. Since the inner dimension is an upper bound on the rank this rules out 
relevant improvements to the factorization of Ai, because the above construction shows that 
the rank is at least 2^1/1^1- 

However, if we restrict our attention to the submatrix of Ai corresponding only to perfect 
matchings (such as we use for the TSP algorithm) then the following improved factorization 
can be established. 

Theorem 3.16 (|17j). Let % be the submatrix of AA restricted to all matchings. Then T~L can 
be factorized into two matrices whose entries can be computed in time {Ul ^, where the inner 
dimension of the factorization is 2^ u ^ 2 ^ 1 . 

Combining this result with the proof technique of Theorem 13. 7\ we obtain the following 
improvement: 

Corollary 3.17. There exists an algorithm reducematchings that given set of weighted match- 
ings A C Il2(U) x N ; outputs in \A\2 2 1^1 time a set of weighted matchings A' Q A 
such that A' represents A and \ A'\ < 2^ u ^ 2 , where oj denotes the matrix multiplication exponent. 

Proof. The proof is almost identical to the proof of Theorem 13. 7t let % = C'C" be the matrix 
factorization from Theorem 13. 161 Then by the same proof, Lemma [3. 141 holds when we replace C 
with C and restrict X and p and r to consist of matchings. Then reducematchings is obtained 
from reduce by replacing C with C . The arguments for the correctness and running times of 
this algorithm are analogous to the arguments from the proof of Theorem 13.71 □ 

Thus, for problems whose dynamic programming formulation via our introduced set of op- 
erators requires only weighted perfect matchings, but not the generality of weighted partitions, 
we get somewhat faster algorithms; among the considered problems this is true for TRAVELING 
Salesman, and it seems unlikely for Steiner Tree or Feedback Vertex Set. 

Theorem 3.18. There exist algorithms that given a graph G solve Traveling Salesman in 
time n(2 + 2 tJ / 2 ) pw pw c '( 1 ) time if a path decomposition of width pw of G is given, and in time 
n(5 + 2 ( - tJ+2 )/ 2 ) tw tw c '( 1 ) time if a tree decomposition of width tw of G is given. 

The proof is analogous to the proof of Theorem 13.91 the only difference being the use of 
reducematchings instead of reduce; for completeness a proof is provided in Appendix IB.4I 
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Combining the ideas from the proof of Theorem 13.181 with Lemma 11.11 and a trick from [p5] 
we obtain the following corollary: 

Corollary 3.19. There is an algorithm solving TRAVELING SALESMAN on cubic graphs in 
1.2186 n n°W time. 

The observation from [18] is that on cubic graphs, we know that the degree of a vertex in a 
subsolution cannot be 2 if at most 1 incident edges is introduced, an it cannot be if at least 2 
edges are introduced since the remaining edge is not enough to make the degree 2. Hence these 
states can be safely ignored. 

Again the proof idea similar to proof of Theorem 13.181 we can also rather easily obtained 
the following result: 

Theorem 3.20. There exist algorithms that given a graph G and integer k finds a path of length 
k in time n(2 + 2 W//2 ) pw (/c +pw) c '( 1 ) time if a path decomposition of width pw of G is given, and 
in time n(5 + 2^ +2 ^ 2 ) tv (k + tw)^ 1 ) time if a tree decomposition of width tw of G is given. 

The idea is to slightly modify the table entries from Subsection 13.41 In the definition of £ x 
we remove the requirement v £ V x \ B x — > deg x (v) = 2, and hence the formula in the forget 
bag has to be altered to A x (s) = A y (s) . Then we can set all weights to 1 and now we are up to 
maximizing uj(X). It is easy to see that our approach can be altered to deal with maximization 
problems and hence this gives the required result since involved weight being more than k ■ tw 
already guarantees that we have a A;-path. 

4 Determinant approach 

In this section we will present the determinant approach that can be used to solve counting 
versions of connectivity problems on graphs of small treewidth. Throughout this section, we 
will assume a graph G along with a path/tree decomposition T of G of with pw or tw is given. 

Let A be an incidence matrix of an orientation of G, that is A = {aij) is a matrix with n 
rows and m columns. Each row of A is indexed with a vertex and each column of A is indexed 
with an edge. The entry a v<e is defined to be if v e; —1 if e = uv and u < v; or 1 if e = uv 
and u > v. We assume, that all the vertices are ordered with respect to the post-ordering of 
their forget nodes in the tree, that is vertices forgotten in a left subtree are smaller than vertices 
forgotten in the right subtree, and a vertex forgotten in a bag x is smaller than a vertex forgotten 
in a bag which is an ancestor of x. Similarly we order edges according to the post-ordering of 
the introduce edge nodes in the tree decomposition. 

Let v\ be an arbitrary fixed vertex and let F be the matrix A with the row corresponding to 
vi removed. For a subset S C E let F$ be the matrix with n — 1 rows and \S\ columns, whose 
columns are those of F with indices in S. The following folklore lemma is used in the proof of 
the Matrix Tree Theorem (see for example [TJ Page 203] where our matrix is denoted by N) 

Lemma 4.1. Let S C E be a subset of size n — 1. If (V, S) is a tree, then | det(i ? s)| = 1 and 
det(Fs) = otherwise. 

In this section we are up to compute the number of connected edgesets X such that X G F 
where F is some implicitly defined set family. Our main idea is to use Lemma 14.11 to reduce 
this task to computing the quantity X^xeJ 7 det(Fx) 2 instead, and to ensure that if X G F is 
connected, then it is a tree. 

For two (not necessarily disjoint) subsets Vi, V2 of an ordered set let us define inv(V"i, V2) = 
I {(it, v) : u £ Vi,v £ V~2,u > v}\. If X,Y are ordered set, recall that for a permutation 
/ : X ^ Y we have that the sign equals sgn(/) = (-l)l{( e i. e 2) :e i. e 2e5A ei <e 2 A/( ei )>/(e 2 )}| _ 
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The following proposition will be useful: 

Proposition 4.2. Let Xi,X r C V and Yi,Y r C E such that X t n X r = and 7; fl 7 r = t) and 

/or every e\ £ Y[ and e2 € Y r we have that e\ < e 2 . Suppose f\ : Y\ — y Xi and f r : Y T — f X r . 
Denote f = /;U f r , that is, f(v) = fi(v) if v G Y\ and f(v) = f r (v) if v G Y r . Then it holds 
that sgn(/) = sgn(/ 1 )sgn(/ 2 ) • (_i)-v(^,x r ). 

To see that the proposition is true, note that from the definition of sgn, the pairs e\, e 2 with 
ei,e2 G Yi or ei,e2 G Y 2 are already accounted for in the part sgn(/i)sgn(/2) so it remains to 
show that 

|{(ei,e 2 ) : ei G Yi,e 2 G F 2 A ei < e 2 A /(ei) > f(e 2 )}\ 
indeed equals inv(X/,X r ), but this is easy to see since we have by assumption that e\ < e 2 . 

4.1 Counting Hamiltonian cycles 

For our first application to counting Hamiltonian cycles, we derive the following formula which 
expresses the number of Hamiltonian cycles of a graph: 



[X is a Hamiltonian cycle] 



XCE 



{a 2-regular graph has n subtrees on n — 1 edges if it is connected and otherwise} 
= -• E [(V, 5) is a tree] 

XCE SCX,\S\=n-l 
y vev deg x (v)=2 

{Lemma ETT1 } 

= \- E E de ^) 2 - 

XCE 5CX,|5|=n-l 
V„ e v deg x (t;)=2 



By plugging the permutation definition of a determinant, we obtain the following expression 
for the number of Hamiltonian cycles of a graph: 



E E ( E ^(/) I] a/(e),e) 2 

E E E sgn(/i)sgn(/ 2 ) JJ a /l(e)je a /2(e))e , 

XCE SCX f , r eeS 



Note that in the last equality we dropped the assumption l^l = n — 1, as it follows from the 
fact that fi (and / 2 ) is a bijection. 

Our goal is to compute the formula by dynamic programming over some nice tree decom- 
position T. To this end, let us define a notion of "partial sum" of the above formula, that we 
will store in our dynamic programming table entries. For every bag x G T, s^eg G {0, l,2} Bx , 
si G {0, l} Bx and s 2 G {0, 1} B * define 
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A r (Sdeg,ai,S2) = Sgn(/i)sgIl(/ 2 ) n a /i(e),e a /2(e),e 

wJly&^M SQX ^y.\M)\*y 

V„ eBl deg x (^)=s deg (^) fr-S^ (V x \{vi})\s 2 1 {0) 

(2) 



Intuitively in s^eg we store the degrees of vertices of B x in G[X], whereas si (and s 2 ) specify 
whether a vertex of B x was already used as a value of the bijection f\ (and f 2 ). 

Leaf bag x: 

4,(0,0,0) = ! 

Introduce vertex v bag x with child y: for Sd cg € {0, l,2} Ba: and s±,s 2 € {0, I} 5 * 
A x (s deg ,s 1 ,s 2 ) ■- 



A y (s deg \B y ,S 1 \B y ,S 2 \B y ) if Sdcg(^) = si(v) = s 2 (v) = 
otherwise. 



Since the vertex v is not incident to any edge from E x , we have that deg^ = and hence 
all summands in which f\ or f 2 map an edge to v will vanish . 



Forget vertex v bag x with child y: for s dcg G {0, l,2} Bx and si,«2 G {0, 1} 
A x (s deg ,S!,s 2 ) = 



A y {s dcg [v -)• 2],si[f -> l],s 2 b ->■ 1]) tfv^vi 
A y (s deg [v — >■ 2], s\[v — > 0],s 2 [v — > 0]) otherwise 



Since d is moved out of B x we need to make sure &eg x (v) = 2, and since no edges incident 
to v will be introduced anymore we require s\{y) = s 2 (v) = 1, unless v = v±: Since it is 
not used as a value for bijections fi, f 2 , we need to handle this vertex separately. 

Introduce edge e = uv bag x with child y: Here we have three cases. Either the edge e is 
not contained in the set X, or it is a part of X \ S, or finally it is a part of S. In the last 
case we need to choose the values /i(e) and f 2 (e) and account for their contribution to 
sgn(/i)sgn(/2), but we can restrict ourselves to values of (s 1 ' 1 (l) \ {vi}) D e and (s^ \ 
{vi}) n e respectively, because otherwise either we do not obtain a bijection or the whole 
summand will disappear since a v / je = for v' e. 

If s Aeg{ u )i s deg {v) > 1, then we set 

A x (s dc g, si,s 2 ) =A y (s dcg , si,s 2 ) + A y (s deg , s 1 ,s 2 ) 

+ X/ A/( s dc g ) s iK ~^ 0],s 2 [w' ->■ 0]) 

u'eis- 1 (iMv^ne 
v'eis- 1 (lMv^ne 

. (_ 1 ynv( S - 1 (l)y)+inv( S - 1 (l)X)^ 

where s' deg is the function s^eg with the values for u and v decreased by one. Observe that 
on the first two mentioned cases are accounted for on the first line. For the third case, we 
need to account for the new number of inversions contributing to sgn(/i)sgn(/2). Note 
that vertices from V x \ B x cannot participate in such an inversion since the vertex and 
edge are both smaller than v' and e due to the ordering. 
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To this end, we can use Proposition 14.21 with Y r = {e} and X r = {v'} since e is the largest 
edge in E x , and it follows that the factor (— l) mv ( s i (i)X)+mv(s 2 (!)>«') indeed accounts for 
the new inversions. 

Finally, when Sdeg(u) = or Sdeg(^) = 0, then we set 

A x (s deg , si,s 2 ) = A y (s deg , si,s 2 ) 

Join bag x with children y and z: 

A x {Sdegi s l) s 2) = ^ Ay(Sdeg,yi s l,yi s 2,y) ' ( s deg,2 j s l,zi s 2,z) 

^dcg^^^dcgjZ ^deg 
S2,y+S2,z=S2 

. (_l)mv( S r,i(l)>^(l))+in V (8^(l), S ^i(l)) 

In the above formula when adding two functions we denote coordinate-wise addition. To 
see that we correctly account for the new number of inversions, first note that vertices 
from V x \ B x cannot participate in such an inversion since the vertex and incident edge 
are both smaller than the vertices appearing in B x and their incident edges e due to the 
ordering. Then by Proposition 14.21 we correctly account for the new inversions since all 
edges from E y are smaller than E z due to the post-ordering of edges. 

Theorem 4.3. There exist algorithms that given a graph G solve # Hamiltonian Cycle in 
©(G^pw^^n 2 ) time if a path decomposition of width pw is given, and in time 0(15 tw tw c '( 1 ^n 2 ) 
time if a tree decomposition of width tw is given. 

Proof. Observe that when all the table entries of a tree decomposition rooted at an empty bag z 
are computed, the number of Hamiltonian cycles is equal to A Z (Q, 0, 0)/n. Moreover each of the 
tw°Wn nodes involves operations on integers of bitlength 0(n log n), since all the table entries 
have absolute value at most n°( n \ 

In the described dynamic programming we have 3 • 2 • 2 = 12 states per vertex, however 
observe that when Sdeg(v) = 0, then all non-zero summands of the partial sum ([2]) satisfy 
si(v) = S2(v) = 0, since otherwise the function f\ (or f 2 ) assigns the value of v to an edge that 
was not incident to v. Similarly when v ^ v\ and s^ eg (v) = 2, then it is enough to store the 
states only with s\{v) = s 2 (v) = 1, because if v was not yet assigned as a value by f\ (or f 2 ), 
then since we can not add to X any more edges incident to v, this table entry will not be used 
as in the forget node we require that s\(v) = s 2 (v) = 1. Hence for each vertex v ^ v\ there are 
only 6 triples (s deg (w), s x {v), s 2 («)), i.e. (0,0,0), (1,0,0), (1,0,1), (1,1,0), (1,1,1) and (2,1,1), 
which is enough to show the claimed running time for path decompositions. 

In case of tree decompositions we need to analyze the time complexity needed to handle 
the summation in join nodes. Observe that there are exactly 15 pairs of triples, which describe 
states of vertices in the left and right subtree, according to the following table, where X denotes 
that this pair is not a valid pair of triples. Hence we can restrict ourselves to these triples when 
evaluating the summation. 

□ 

4.2 Counting Steiner Trees 

In this section we show how to count the number of Steiner trees of a prescribed size. Let v\ 
be an arbitrary fixed terminal from K. The number of Steiner trees with exactly k edges is 
expressed by the following formula. 
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(1,1,0) 


(1,1,1) 
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(1,1,0) 


(1,1,1) 
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X 


X 
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(1,0,1) 
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X 


(2,1,1) 


X 
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(1,1,0) 


(1,1,0) 
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(2,1,1) 
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(1,1,1) 


(1,1,1) 


(2,1,1) 


X 


X 


X 


X 


(2,1,1) 


(2,1,1) 


X 


X 


X 


X 


X 



y~] [X is a Steiner tree] = E E [(Y, X) is a tree] 

XQE,\X\=k YCV,\Y\=k-l,KCY XCE(Y,Y),\X\=\Y\-1 

E E det(F Y , x ) 2 

rcy,|y|=fe-i,i<:cyxcE(y,y),|x|=|y|-i 

where Fyx is the submatrix of F with rows in V \ {v±} and columns in X. Again, by 
plugging the permutation definition of a determinant we obtain: 

E E E s S n (/l)sg n (/2) n a /l(e),eO/ 2 ( e ), e , 

YCV,\Y\=k-l,KCYXCE(Y,Y),\X\=\Y\-l flj2:X WY\{ Vl } eeX 

Where Sgn(/) = (-l)l{( e i' e 2) :e l. e 26XAei<e2A/(ei)>/(e 2 )}| _ 

Let us define a "partial sum" of the above formula. For every bag x E T, < i < \V X \, 
s Y G {0, 1} B *, si e {0, 1} B * and s 2 G {0, l} Bx define: 

A x (i,ay,ai,s 2 ) = EE E sgn(/i)sgn(/ 2 ) a /l{e)ie a /2(e)je . 

YCV* XCE(Y,Y)nE x fi:X ^ Y \ { v l} \s^ (0) ^ X 
(Kr\V x )CY f 2 :X 1 ^ 1 Y\{v 1 }\ 8 2 1 (p) 

ynBa ; =Sy 1 (i) 



Note that in the above definition when sy(t>) = 0, then in order to have a non-zero table 
entry we need to have s\(v) = s 2 (w) = 0, since otherwise an edge of X would be assigned (by 
/i or / 2 ) a vertex which is not its endpoint, which leaves only 5 reasonable states per vertex. 

Leaf bag x: 

A X (O,0,0,0) = 1 

Introduce vertex v bag x with child y: for < i < \V X \, sy G {0, l} Bx and Si,s 2 G 
{0, 1} B * 



A x (i,s Y ,s 1 ,s 2 ) = < 



' A y (i, sy\b v , si\b v , S2\b v ) if s Y {v) = si(v) = s 2 (v) = Q,v K 

A y (i - l,sy|s J ,,si|B J/ ,S2|s J ,) if s Y (v) = l,si(v) = s 2 (v) = 
otherwise. 



Note that the choice of including (or not) the vertex v into Y is described by s Y (v) and 
moreover if v G K then we have to include v into Y. 
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Forget vertex v bag x with child y: for < i < \V X \, sy & {0, l} Bx and si, s 2 G {0, l} Bx 



A x (i,s Y ,s 1 ,s 2 ) = < 



A y (i,SY[v -¥ l],si[v -)• l],s 2 [v ->•!]) if u G K, u / t>i 

A,(i, sy[t> — >■ 1], si[v — > 0], s 2 [i> — >■ 0]) if f = ui 
A,(i,sy[z; l],ai[« -»• l],s 2 [« -> 1]) 

+^4 y (z , sy [f — )■ 0] , s i [v — > 0] , S2 [v — > 0] ) otherwise 



Introduce edge e = uv bag x with child y: 

A x (i, s Y , si,s 2 ) =A y (i, s Y ,si,s 2 ) 

+ X/ s y,si[u' ->■ 0],s 2 [i; / ->■ 0]) 

^u',e ' ®v f ,e 

«'6( S2 - 1 (l)\{«i})ne 
• [ Sy ( U ) = ay(u) = l](_l)inv( Sl 1 (l)y)+mv( S2 - 1 (l)X) 

Join bag x with children y and z: 

A x (sy,Si,S 2 ) = ^ A/( S ^, S 1,2/, S 2,2/) • 4j(sy , S 2 ,z) 

Sl 1 j/+Sl,z=Sl 

S2, H +S2, Z =S2 

. (_l)inv( S ^(l)^r,'(l))+mv(^(l),s 2 ^(l)) 

Observe that the functions sy is used in both children, to make the choice of taking a 
vertex to Y or not consistent between the two subtrees. 

Theorem 4.4. There exist algorithms that given a graph G counts the number of Steiner trees 
of size i for each 1 < i < n — 1 in 0(5 pw pv°^n 3 ) time if a path decomposition of width pw is 
given, and in time O(10 tv tw°^n 3 ) time if a tree decomposition of width tw is given. 

Proof. Observe that when all the table entries of a tree decomposition rooted at an empty bag 
z are computed, the number of Steiner trees with exactly i edges is equal to A z (i + 1,0,0,0). 
Moreover each of the tw°^n nodes involes operations on integers of bitlength 0(n log n), since 
all the table entries have absolute value at most n°( n \ 

As we have already noted we can assume that for each vertex v ^ v\ the triple (sy(v), s\(v), s 2 (i 
is of one of the following forms (0,0,0), (1,0,0), (1,0,1), (1,1,0), (1,1,1), which is enough to 
prove the claimed running time for path decompositions. 

In order to handle join nodes effectively, observe that there are exactly 10 pairs of triples, 
which describe states of vertices in the left and right subtree, according to the following table, 
where X denotes that this pair is not a valid pair of triples. 





(0,0,0) 


(1,0,0) 


(1,0,1) 


(1,1,0) 


(1,1,1) 


(0,0,0) 


(0,0,0) 


X 


X 


X 


X 


(1,0,0) 


X 


(1,0,0) 


(1,0,1) 


(1,1,0) 


(1,1,1) 


(1,0,1) 


X 


(1,0,1) 


X 


(1,1,1) 


X 


(1,1,0) 


X 


(1,1,0) 


(1,1,1) 


X 


X 


(1,1,1) 


X 


(1,1,1) 


X 


X 


X 



□ 
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4.3 Feedback Vertex Set 



Note that to solve the Feedback Vertex Set problem it is enough to solve its dual, which 
will be easier to work with in the squared determinant framework. 

Maximum Induced Forest 

Input: An undirected graph G, an integer k and a nice tree decomposition T of G of width 
tw. 

Question: Find a set Y C V such that \Y\ > k and G[Y] is a forest. 

Without loss of generality we can assume that the graph G contains an isolated vertex, which 
we denote as v\. Since if such vertex is not present we can add it, increase k by one and update 
the tree decomposition accordingly. Clearly v\ is contained in any maximal induced forest. So 
far by using squared determinant we counted trees, but now we want to check whether there 
exists an induced forest of a prescribed size. To achieve this we define a new set of edges E' 
containing all the edges between v\ and (note that E'C\E(G) = 0). Observe, that there 

exists an induced forest containing v\ with no vertices and mo edges (hence n — mo connected 
components) in G iff there exists an induced tree in G' = (V, E(G) U E') containing v\ with no 
vertices and n — mo — 1 edges of E'. Therefore it is enough to count induced trees in G', while 
keeping track of the number of used edges from E 1 . Consequently it is enough to find, whether 
the following sum is positive 

E E [(y,*) is a tree] 

YCV,vi£Y,\Y\=kXCE(Y,Y)UE'(Y,Y) 
E{Y,Y)CX 
\X\ = \Y\-l 

= E E det(^ x ) 2 

YCV,vieY,\Y\=k XQE(Y,Y)VJE'(Y,Y) 
E{Y,Y)CX 
\X\ = \Y\-l 

where F Y x is an orientation of an incidence matrix of G with rows from Y \{v\} and columns 
from X. By pluggin the permutation definition of the determinant we obtain the following 

E E E sgn(/i)sgn(/ 2 ) Y\ a Me y e a MeYe 

YCV^Y^kXCEiYXYJE^Y) hJr .xWY\ M ^ X 

where sgn(/) = (— l)l{( e i' e 2) :e i. e 2eXAei<e 2 A/(ei)>/(e 2 )}|_ N t e that we have removed the assump- 
tion that \X\ = \Y\ — 1 as this is enforced by the assumption that /i is a bijection. 

Observe, that a tree decomposition of G one can obtain a tree decomposition of G' of width 
increase by at most one by ensuring that v\ is included in every bag. Therefore we assume that 
we are given a nice tree decomposition T of G' . Let us define a "partial sum" of the above 
formula. For every bag x G T, < i < \V X \, s Y G {0, 1} B * , si G {0, 1} B * and s 2 G {0, 1} B * 
define: 



A x (i,s Y ,si,s 2 ) = EE E sgn(/i)sgn(/ 2 ) a /l{e)ie a /2(e)je 

YCV X XCE X f yl-U, w.-lfnl eGX 

(Mnv^cY E x nE(Y,Y)cx ~* Y \i v ^\ s i (°) 

\Y\=i f 2 :xWY\{v 1 }\s^\0) 
YnB^=Sy 1 (l) 

The dynamic programming part of our algorithm is very similar to the one described for 
Steiner Tree. 
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Leaf bag x: 

4,(0,0,0,0) = ! 

Introduce vertex v bag x with child y: for < i < \V X \, sy G {0, and si,S2 G 

{0, 1} B * 

{A y (i, sy\b v , s^By, s 2 \b v ) if sy(v) = si(v) = s 2 (v) =0, v ^=v 1 

A y (i - l,S Y \B y ,Sl\B y ,S2\B y ) if s Y (v) = l,si(v) = s 2 (v) = 

otherwise. 

Note that v\ has to be included into Y. 
Forget vertex v bag x with child y: for < i < \V X \, sy G {0, l} Bx and si,s 2 G {0, l} Bx 

' A y (i, s Y [v ->■ 1], ->■ 0], s 2 [v ->■ 0]) if w = ui 

^+^4 y (i, sy [u — >■ 0],si[w — )■ 0],S2[w — > 0]) otherwise 

Introduce edge e = uv bag x with child y: 

A x (i, s Y ,si,s 2 ) =[e efi'v sy(u) = V s Y (v) = 0]A y (i, sy, si, s 2 ) 

+ X/ ^(i, Sy,Si[u' ->■ 0],S 2 ['y / ->■ 0]) 

u'eis- 1 (lMv^ne 
v'eis- 1 (lMv^ne 

Observe that we have an option of not including e into X only if e G E' or min(sy(u), sy(f )) 
0. 

Join bag x with children y and z: 

^x(sy,Sl,S2)= ^ Ay{sY,Sl, y ,S2,y) ■ A z (s Y ,Si >z ,S 2 ,z) 

51, y+Sl t z=Sl 

52, y+S2,z=S2 

. (_l)inv( S ^(l)^r,'(l))+mv(^(l),s 2 ^(l)) 

Observe that the functions sy is used in both children, to make the choice of taking a 
vertex to Y or not consistent between the two subtrees. 

Theorem 4.5. There exist algorithms that given a graph G solves the Feedback Vertex 
Set problem in 0(5 time if a path decomposition of width pw is given, and in time 

O(10 tv tw°^n 3 ) time if a tree decomposition of width tw is given. 

Proof. Observe that when all the table entries of a tree decomposition rooted at an empty bag z 
are computed, the there exists an induced forest in G with no vertices iff A z (no + 1, 0, 0, 0) > 0. 
Moreover each of the tw°^n nodes involes operations on integers of bitlength 0(n log re), since 
all the table entries have absolute value at most n°^ n \ 

Similarly as in the case of Steiner Tree we can assume that each vertex v ^ v\ the triple 
{sy{v),si{v),s 2 {v)) is of one of the following forms (0,0,0), (1,0,0), (1,0,1), (1,1,0), (1,1,1), 
which is enough to prove the claimed running time for path decompositions. 

In order to handle join nodes effectively, observe that there are exactly 10 pairs of triples, 
which describe states of vertices in the left and right subtree, according to the following table, 
where X denotes that this pair is not a valid pair of triples. The table is identical to the one 
used in the Steiner Tree problem. 

□ 
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(0,0,0) 


(1,0,0) 


(1,0,1) 


(1,1,0) 


(1,1,1) 


(0,0,0) 


(0,0,0) 


X 


X 


X 


X 


(1,0,0) 


X 


(1,0,0) 


(1,0,1) 


(1,1,0) 


(1,1,1) 


(1,0,1) 


X 


(1,0,1) 


X 


(1,1,1) 


X 


(1,1,0) 


X 


(1,1,0) 


(1,1,1) 


X 


X 


(1,1,1) 


X 


(1,1,1) 


X 


X 


X 



5 Conclusions 

In this paper, we have given deterministic algorithms for connectivity problems on graphs of 
small treewidth, with the running time only single exponential in the treewidth. We have 
given two different techniques. Each technique solves the standard unweighted versions, but 
for variants (counting, weighted versions, . . . ), sometimes only one of the techniques appears 
to be usable. Both techniques make novel use of classic linear algebra. As the treewidth and 
branchwidth of a graph differ by a constant factor, our algorithms also work for graphs of 
bounded branchwidth, and one can easily translate our algorithms to algorithms working on 
branch decompositions. 

Our work improves upon the Cut&Count approach not only by having deterministic algo- 
rithms, but also (some of) our algorithms only use time that is linear in the number of vertices 
in the graph. However, the base of the exponent is somewhat larger, and an important question 
is whether this can be reduced. In the rank-based approach, this amounts to the following ques- 
tion: Can Algorithm reduce from the proof of Theorem 13.71 be implemented in linear time? It 
would also be interesting to have a linear time implementation of Algorithm reducematchings 
from Corollary 13. 171 

We believe that our algorithms not only break a theoretical barrier, but may also be of 
practical use. A possible algorithm for e.g., Hamiltonian Circuit may be the following: run the 
standard DP on the tree decomposition, but as soon as we work with a table of size larger than 
2 tw , we can use the rank-based approach and remove table entries by finding a base. Thus, we 
are guaranteed that we never have to process tables of size larger than 2 tw , at the cost of running 
a number of Gaussian elimination steps. It would be very interesting to perform an algorithm 
engineering study on this approach. It also may be interesting to see how this combines with a 
well known heuristic by Cook and Seymour for TSP [15], that uses finding a minimum length 
Hamiltonian Circuit in a graph with small branchwidth as a central step. 

A final very intriguing question that our work implies is the following: Is the rank-based 
approach also usable in settings outside graphs of small treewidth? The rank-based approach 
gives a new twist to the dynamic programming approach, in the sense that we consider the 
"algebraic structure" of the partial certificates in a quite novel way. Thus, this suggests a study 
of this algebraic structure for dynamic programming algorithms for problems in other areas. 

We would like to mention that uses of the rank based approach could also be found in work 
on rank- width boolean- width [30} [TTj , but in these cases the rank structure exploited is by more 
explicit assumption present in the input. 
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A Omitted proofs of Section [2] 



A. l Proof of Proposition 12.21 

Proof, (sketch) We briefly sketch how to get a nice tree decomposition that is rooted at the 
introduce edge bag for a chosen edge {u, v} G E. To get an empty root bag instead, it suffices 
to add a series of forget vertex bags that ends in a new (empty) root. 

Let T be a tree decomposition for G and let {u, v } 6 E be the chosen edge. Pick an arbitrary 
bag, say B r , of T that contains both u and v or forget v as the root and follow the arguments 
given by Kloks [2| to generate a nice tree decomposition with root bag B r in linear time. 

Now additionally do the following. Below each leaf add a series of introduce vertex bags, 
starting from an empty bag, to make all (new) leaf bags be empty. Regarding the introduce 
edge bags, first observe that for each vertex there is only one forget vertex bag; this follows 
from the connectedness property of tree decompositions. To add an introduce edge bag for an 
edge {p, q} take the higher of the forget vertex bags for p and q, split the bag into two identical 
copies and use the lower one to introduce {p, q}. For the root bag B r , this requires a series 
of forget vertex bags, until only u and v are left in the highest bag. Then use that bag to 
introduce {u, v}. □ 

B Omitted proofs of Section [3] 

B. l Proof of Lemma ETT5I 

Proof. For every p, q E il(f7) : 

(cc T )[ P , q ]= ]T [^^epIK^^c?] 

(Vi,V2)ecuts(t) 

l(Vi,V 2 ) Q p A (V^) Q q] 

(Vi,v 2 )ecuts(t) 
(Vi,v 2 )ecuts(t) 

_ 2#blocks(p n?)-i 
= \pnq = {U}}. 

The key here is that we count the number of cuts which are coarser than both p and q, i.e., 
cuts (Vi, V2) S cuts(t) such that each set of p or q is completely contained in V\ or V%. It follows 
easily, that this is equivalent to each set of p n q being contained in V\ or V2. Considering the 
blocks of p n q it is clear that the block containing 1 must be in V\, by the definition of cuts(t). 
Any further block can be either in V± or V2, which gives a total of 2# blocks (f n coarser cuts. 
Clearly, that number is odd if and only if there is a single block in p n q (the one containing 1), 
i.e., if p n q = {U}. □ 

B.2 Proof of Lemma [37T51 

Proof. First observe that a basis minimizing the weight is just a lexicographicaly minimum 
basis, as independent sets of rows form a matroid. Notice that we may assume that n < 2m 
since we can start with the first m rows and then iteratively introduce m new rows, find a new 
basis and discard all introduced rows not in this basis. This takes at most n/m iterations, so if 
we manage to perform one iteration in m u time, this procedure indeed implements the lemma. 
Recall that a matrix is in row echelon form if 
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1. All nonzero rows (rows with at least one 1) are above all rows of all zeroes. 

2. The leading coefficient (the first nonzero number from the left, also called the pivot) of a 
nonzero row is always strictly to the right of the leading coefficient of the row above it. 

3. All entries in a column below a leading entry are zeroes (implied by the first two criteria) 

We use the folklore fact that an n x 2n matrix can be brought into row-echelon form that is 
obtained using only elementary row operations in 0{n u ) time (see for example [12} Proposition 
16.9]). 

We proceed as follows: given an n x m matrix with m < n < 2m we first transpose 
it and then sort the columns on their weight in increasing order. Then we bring it in row- 
echelon form in 0{m u ) as discussed above. Since elementary row operations preserve linear 
column combinations we can now restrict ourselves to finding a minimum weight basis in the 
obtained matrix that is in reduced echelon form. And it is easy to see that in this matrix the 
minimum weight basis is exactly the set of columns that contain a leading 1: it is clearly a set 
of linearly independent columns, and if a column is not in the basis it can be expressed as a 
linear combination of columns to the left of it since for all non-zero entries of that column there 
is a leading 1 appear on the same row in a column before it by the row echelon property. □ 

B.3 Proof of Lemma 13.61 

Proof. In the following let U be a set, let A, A' C H(U) x N, and assume that A' represents 
A. Note that the union and join operations are symmetric and hence we only need to show the 
preservation of representation with respect to one of the parameters. 

Union: We have for all q G U(U) and B C U(U) x N that 

opt(q,A' tb B) = min{opt(<?,„4'),opt(g,,B)} = min{opt(g, A), opt(g, B)} = opt(q,A^)B). 

Insert: We may assume that X = {e} since for YPiZ = 0, ins(YUZ, A) equals ins(Y, ins(Z, A)). 
Note that if {e} G q, opt(g, ins({e}, C)) = oo and representation is preserved trivially. 
Otherwise, we have for every C C II(?7) x N and any q G H(U U {e}) with {e} ^ q that 

opt(g, ins({e},C)) = min{w \ (p,w) G C Ap Wu{e} n q = {U U {e}}} 
= min {w | (p, w) G C A p n qyj = {U}} 
= oj>t(q±u,C). 

Note that the second equivalence uses the fact that e must be connected to some e' G U 
in q, since {e} ^ q. Now preservation of representation follows since 

°pt(g, ins({e},^4')) = ^iliu,^) = opt(q iU ,A) = opt(g, ins({e}, A')). 
Shift: We have for all q G 11(17) and w' G N that 

opt(g, shf t(w', A 1 )) = w' + opt(g, A') = w' + opt(g, A) = opt(g, shf t(w' , A)). 

Glue: We may assume that a,b G U since otherwise glue(a&, A) = ins({a, b} \ U, glue(a&, A)). 
Note that for every C C Il(U) x N and any q G II(ZJ) we have that 

opt(g, glue(a6, C)) = min {w \(p,w) G C A (p n U[ab]) n q = {U}} 
= min {w | (p, w) G C A p n (g n U[ab]) = {U}} 
= opt(g n U[ab],C)- 
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Then preservation of representation follows since 



opt (q, glue (ab, A')) = opt(g l~l U[ab],A') = opt(q l~l U[ab],A) = opt(q, glue(a6, A)). 

It is clear from its definition that the variant of Glue with three parameters also preserves 
representation. 

Project: We may assume that X = {e} since for Y(~)Z = 0, proj (YUZ, A) equals proj (Y, proj [Z. 
Then for every C C T1(U) x N and any q G U(U \ {e}) we have that 

opt(g, proj ({e}, C)) = min {w | (p, w) G C A p±u\{e} n Q = W \ {e}} A {e} i p] 
= min {w | (p, w) G C A p n g-f-f/ = {[/}} 
= opt(g w ,C). 

Now preservation of representation follows directly 

opt(g,proj({e},^')) = opt(g tc/ , A') = opt{q tu ,A) = opt(g,proj ({e}, ^.)). 

Join: We may assume that A,B C n(L r ) x N since otherwise we can use 

joints) = join(ins([/ / \ C/,^),ins(C7 \ U',B)). 

For every ^ C H(U) x N and r G n(J7) it holds that 

opt(r, join(^,',i3)) = min + ^2 G A', (1V2, q) G A p n g n r = {?/} j 

= min{opt(g l~l r, ^.') + tt>2 | {w2,q) G 0} 
= min{opt(g l~l r, A) + W2 \ {w2,q) G ^} 



mm <wi J rW2 



(w!,p) G .A, (w 2 ,q) £BApHqnr = 



opt(r, join(A,e)). □ 



B.4 Proof of Theorem I3A81 

Proof. The algorithm is the following: use the above dynamic programming formulation from 
Subsection 13.41 to compute A r , but after evaluation of every entry A x , use Theorem 13.71 to store 
reducematching(A^) rather than A x . This is possible because by definition A x clearly is a 
set of weighted matchings. Since reducematchings(^l) represents A and the recurrence uses 
only the operators defined in Definition 13.21 which all preserve representation by Lemma 13.61 
we have as invariant that for every x G T the entry stored for A x represents A x by Lemma 13.61 
In particular, the stored value for ^4 r (s) dominates A r (s) and hence we can safely read off the 
answer to the problem as done in Section 13.41 

Let us focus on the time analysis: since for all operations from Definition 13.21 we can apply 
Proposition 13.31 the bottleneck clearly is the reducematchings algorithm. Recall that the 
guessing of the edge v\v n gives overhead of at most pw or tw so this will be subsumed by the 
last term of the claimed running time. 

In the first algorithm that is given a path decomposition, note we can assume x is either a 
leaf, introduce vertex, forget vertex or introduce edge bag. In this case the size of A x (s) is by 
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our invariant at most 2^ s 1 ( 1 )l/ 2 . Then the time needed to perform reducematchings( J 4 :E (s)) is 
at most 2 w / 2 l s ~ 1 Wlpw c ' (1 ) and the time to compute A x (s) for every {0, 1, 2} Bx is 



^2 2 -/2| S -Hi)i pw o(i) < (■ ^ Bx 

se{0,l,2} B - io+h+i2=\B x \ V '* 1 ' 



l i °l i2 (2 u, ' /2 ) il pw 0(1) 



= (2 + 2 w / 2 )l^lpu°( 1 ), 



where the last equality is due to the multinomial theorem. Hence A x can be computed for every 
x G T in the claimed time bound. 

For tree decompositions, note that if x is a join bag then 

\B X \ 

\A X ( S )\< 2 U- 1 (l)|/2 2 |^- 1 (l)l/2 = J-|- ^ 2[' =1 l/ 2+ [ r - =1 l/ 2 = (23/2)|«- 1 (l)l 4 l«- 1 (2)|_ 

l+r=s i=l l+r=Si 

where we use in the second-last equation that 



2 [k 



=l]/2+[r i= l]/2 



'1 


if Si 


= 


< 2 3 / 2 


if Si 


= 1 


4 

V 


if Si 


= 2. 



(3) 



Using this, it can also be seen that the reduce operation on A x (s) is performed in time 
bounded by (23/ 2 )l^ 1 (i)l4l^ 1 (2)| 2 ( w -i)/2| s - 1 (i)| \B X \°^ . Then the total time needed to evaluate 
A x (s) for every s <E {0, 1, 2} Bx is bounded by 



E 

lO+tl+l2 = \B x \ 



\B X \ 



^2( w +2)/2yi^2 _ ^ _|_ 2( UJ + 2 )/ 2 ^\ B *\ 



and the claimed running time follows by the multinomial theorem. 



□ 
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